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The notion of equivalence for group codes is explored in some detail. A 
dual for a code, and the sum and product of two or more codes, are defined. 
Properties of these, constructs arc investigated. Indecomposable codes are 
defined and are shown to be optimal in two different senses. Various classes 
of codes are enumerated. 

INTRODUCTION 

This paper is a collection of results on the theory of group error-cor- 
recting codes for use on binary channels. It investigates further certain 
topics introduced in an earlier paper 1 by the author. The reader will 
he assumed to be familiar with the contents of this earlier paper as well 
as with the general nature of the coding problem in information theory. 

The evident trend to digital transmission systems has given rise in 
recent years to an increased interest in coding as a possible practical 
means of error control. Lacking an "explicit solution" to the coding 
problem in any real sense, many investigators have chosen in an ad hoc 
maimer promising special classes of parity-check codes and have ex- 
amined their properties. A large and useful literature of special codes 
has resulted. 

The approach taken here is different. Xo special codes are examined; 
rather, we attempt to shed some additional light on the structure of the 
class of all group codes. Our original aim was to parametrize in some 
manner the various equivalence classes of group codes. If such a parame- 
trization could be effected, one could then hope to express the error 
probability of a code in terms of the parameters, and possibly to see how 
to choose the parameters to obtain codes of small error probability. We 
have fallen far short of this goal. 

The main results to lie found in this paper arc as follows. A natural 
dual for a group cod; is defined. For any two group codes, a product 
code and a sum code are defined and certain properties of these opera- 
tions are investigated These operations have the important, property of 

1219 



1220 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1960 

maintaining equivalence in the sense that if a and a' are equivalent 
group codes and (B and (B' are equivalent group codes, then a + (B is 
equivalent to a' + (B' and (KB is equivalent to Ct'(B'. This result in turn 
leads to an arithmetic of equivalence classes of codes. The notion of an 
(additively) indecomposable equivalence class is introduced, and it is 
shown that an arbitrary equivalence class can be written in a unique 
manner as a sum of indecomposable equivalence classes. It is then 
shown that one can limit the search for best codes (with two commonly 
used meanings for "best") to the indecomposable equivalence classes. 
Enumeration formulae for the types of equivalence classes are given, 
and these formulae are evaluated for small values of the pertinent param- 
eters. 

In the interest of simplicity of exposition, we have restricted our at- 
tention to binary codes, although many of the results obtained hold for 
codes consisting of sequences of elements drawn from any finite field. 
Also, in an effort to make the paper available to as wide a class of readers 
as possible, we have carefully eschewed the specialized vocabulary of 
modern algebra,* although many of our results could be stated more 
succinctly in these terms. In addition, as an aid to the casual reader 
we adopt once more the format of Ref. 1: Part I contains definitions, 
examples and results; Part II contains additional theory and proofs 
of the less obvious assertions of Part I. The terminology of Ref. 1 is 
maintained with one exception: the word "code" is here used as a syno- 
nym for "alphabet," as has become accepted practice in the literature. 

There is some overlap of material with that found in the paper of 
Fontaine and Peterson 2 which appeared after much of this work was 
done. In the interest of making this paper self-contained, we repeat some 
material that might have been quoted from that paper. 

Part I — DEFINITIONS, EXAMPLES AND RESULTS 

1.1 Recall of Previous Paper and Some New Definitions 

An (n,k) -alphabet, or (n,fc)-code, is an unordered collection of 2 dis- 
tinct n-place binary sequences that forms an Abelian group under the 
operation of mod 2 addition of the sequences term by term. The ele- 
ments of the group, that is, the n-place binary sequences, are also called 
"letters." We assume always in this paper that n ^ k > 0. 

We denote specific group codes by large script letters, a, (B, etc. We 
denote the letters of ft by .4 1 , /1 2 , etc., and the digits of a letter by lower- 
case Latin letters. Thus, for example, a particular letter of the (n,k)- 

* In modern terminology, we are studying properties of subspaces of a finite 
dimensional linear vector space over a finite field. 
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code a is the binary sequence Ai = (oi , a 2 , • • ■ , a„). It is frequently 
convenient to regard the letters A\ , A 2 , etc. as n-dimensional vectors. 

A particular («-,£) -code can be specified by listing its 2* letters. It 
can also be specified by listing k of its generators, i.e., any k linearly in- 
dependent letters of the code. These A- generators can be displayed as a 
binary matrix of rank k, with k rows and n columns. The rows of the 
matrix are the generators of the code. Such a matrix will be called a 
generator matrix and will be denoted typically by the symbol S2. When 
referring to different generator matrices of a specific code Q,, we shall 
write fii(Ct), ft 2 (a), etc. 

Many generator matrices correspond to the same code. The first 
generator can be chosen in 2 — 1 ways, since the all-zero sequence or 
identity, /, of the group code cannot serve as a generator. The second 
generator can be chosen in 2—2 ways. The third can be chosen in 
2 k — 2 ways, since the first two generators determine a group of order 
2 2 . Proceeding in this way, we find 

M k = (2* - 2°) (2* - 2 1 )(2 fc - 2 2 ) • • • (2* - 2*" 1 ) 

= 2 Hk - x)l \2 k - \){2 k ~ l - \){2 k ' 2 - 1) ••• (3)(1) 

different generator matrices for a given (n,/o)-code. Indeed, if Q x and fi 2 
are generator matrices for the same code, then 12, = g$l 2 , where a is a 
nonsingular k X k binary matrix and all operations implied in the matrix 
product g&2 are carried out mod 2. The collection of k X k nonsingular 
binary matrices forms a group under matrix multiplication (arthimetic 
mod 2) which we shall denote by G* . Gk is of order Mk . [Gt is the 
general linear group of dimension A- over a field of two elements, fre- 
quently denoted by GL(k, 2).] If is any generator matrix for an (n,k)- 
code, then, as g runs through G k - , gil gives the Mk distinct generator 
matrices associated with the code. 

In all that follows we shall frequently omit the phrase "all arithmetic 
mod 2." It will generally be clear from the context whether the field in 
question is the reals, the complex numbers, or the two element field. 

It was shown in Ref . 1 that every group code is a parity-check code and 
that every parity-check code is a group code. Let A be a binary matrix 
of n — k = I rows and n columns and of rank I. Let X,-> be the entry in 
the t'th row andjth column of A, * — 1,2, • • • , I and j = 1, 2, • ■ • , n. 
The equations 

Ai = (2) 

or 

Y,\ijP,j = 0, i = 1, 2, ■•• ,1, 
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where A is the binary row vector A = (a x , a 2 , • • • , a n ) and the tilde 
denotes transpose, have k linearly independent solutions, say Ai , A 2 , 
• • • , A k . These k vectors can be taken as the generators of an (n,k)- 
code. Since every linear combination of the vectors Ai , • • • , A k also 
satisfies (2), every generator matrix Q of this (rc,fr)-code satisfies 

AQ = 0. 

The matrix A is called a parity-check matrix for the (w,A-)-codc. 

A given (n,fc)-code has many parity-check matrices. Indeed, if A is 
one such, so is gA for every g contained in G„- k ■ There are therefore 
Mn-k distinct parity-check matrices associated with a given (w,A-)-code. 
We shall denote the different parity-check matrices of a specific (n,k)- 
code a by A^ft), A 2 (ft),etc. 

1.2 Equivalence 

As in Ref. 1, we define two (n,k) -codes to be equivalent if one can be 
obtained from the other by a fixed permutation of the places of every 
letter. The concept has been illustrated in Section 1.7 of Ref. 1. Equiva- 
lent (n,k) -codes have the same transmission properties over the binary 
symmetric channel. 

We denote the fact that codes ft and (B are equivalent by the sym- 
bolism ft ^ (B. It is immediately established that this is a true equiva- 
lence relation; i.e., that ft ^ ft; that ft ^ (B implies (B ^ ft; and that 
if ft = (B and (B = e, then ft ^ e. The totality of (n,fc)-codes can 
therefore be broken down into disjoint equivalence classes. We denote 
by ft the equivalence class containing ft. 

This equivalence of codes induces an equivalence relation among the 
totality of possible generator matrices. Two such matrices, say £2i and 
fia , will be called equivalent (written fi, ^ S22) if there exists a g in G k 
and an n X n permutation matrix <r such that gtti<r = J2 2 . That is, two 
/,• X n fi-mat rices are equivalent if one can be obtained from the other 
by permuting columns and/or forming nonsingular linear combinations 
of the rows mod 2. Clearly, two equivalent ft-matrices, when considered 
as generator matrices, give rise to equivalent codes. Equivalent codes 
have equivalent generator matrices. 

The task of analyzing group codes would be greatly simplified if a 
canonical form could be found for each equivalence class of fi-matrices. 
That is, for a given n and k, we should like to be able to write down one 
generator matrix from each equivalence class. This would provide a 
simple means of describing each of the essentially different (n,k) -codes. 
The number of equivalence classes of (n,k) -codes is very much smaller 
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than the number of distinct (n,k) -codes. They are enumerated in Sec- 
tion 1.9. Here we present further only two results pertaining to equiva- 
lence. 

Every k X n Q-matrix is equivalent to an tt-mafrix whose first k rows and 
columns are the k X A" unit matrix. That is, fi is equivalent to the parti- 
tioned matrix 12 = (/*• ■ M), where h is the k X k unit matrix and M is 
a matrix of k rows and I = n — k columns. 

An fi-matrix with the above structure will be said to be in M-form. 
Unfortunately, two k X n ft-matrices in M-form having different M- 
matrices (even apart from permutations of rows and columns) can be 
equivalent. 

A second result is 

Theorem 1: A necessary and sufficient condition for two k X n ^-matri- 
ces to be equivalent is that their columns can be placed into a one-to-one 
correspondence that preserves mod 2 addition of the columns. 

Examples: Let 



9.! = 



10 11 



1 




1 

1 



B 2 = 



1 1 


1 1 


1 


1 


1 


1 



Then S2| = ft 2 . for if we denote the columns of Qj by Ui , w 2 , • • • , u* and 
those of Qo by v% , tfc , ■ • ■ , r 5 and establish the correspondence «i <-> v 3 , 

Uo <-> v b , u 3 <-> v 2 , u 4 <-> v x , u b <-» v 4 , one sees that Ui , ih , u 3 are independent 
as are v 3 i *'s , ''2 and that the equations n* = m -f- u-> and u<, = in -f 
n-> + Ms have the analogs i\ = v 3 + v b and v 4 = v 3 + v b + v 2 . Both Q t 
and 2 are equivalent to 



Qa = 



The matrices fti and & 3 are both in M-form and are equivalent, although 
they have different M -matrices. 

The preceding considerations of equivalence for ^-matrices have their 
obvious analogs for parity-check matrices. 



1 





1 








1 


1 


1 








1 


1 



1.3 Duality 

There is a natural duality between (n,k) -codes and (n,0 -codes, where 
I = n — k. In Ref. 1 it was noted that the two sets of codes are equi- 
numerous. We elaborate further on this notion here. 
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In Section 1.1 it was remarked that every generator matrix 12(a) for 
a given (n,A;)-code G and every parity check matrix A(G) for this code 
satisfies 

A(e)o(a) = o. (3) 

The transpose of this relation is 

i2(a)A(a) = o. 

Thus, every partly check matrix A (ft) of an (n,k)-code a can be regarded 
as a generator matrix for a particular (n,l)-code hereafter called the dual 
of a and denoted a f . Every generator matrix Sl(a) is a parity check matrix 
for a f . 

The above can be regarded as defining ft f by the relation 

fl(a f ) = A(G). 

One immediately finds that 

(a + ) + = a (4) 

and that 

a ^ (B implies a f ^ (B + . (5) 

The equivalence classes of (n,k) -codes can therefore be put in a natural 
way into one-to-one correspondence with the equivalence classes of 
(n,l) -codes: 

G, corresponds to G + . 

It is convenient to define 

(ft) 1 " = a^. 

There is a simple way of passing from a k X n generator matrix 12 in 
M-form for a code in a to a generator matrix 12' in i¥-form for a code 
in & + . If 12 = (h- I M) defines a code in a, then 12' - (/, \ M) defines 
a code in & 1 ". Here M is the transpose of M. 

1.4 The Sum of Two Codes 

Let a be an (n,k)-code and (B be an (n',k')-code. We define a new 
code 6 by the partitioned generator matrix 

/a(a) j \ 

n(e) = ; . (0) 

\ o ;g(<b)/ 
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The code Qis an (n + n', k + k')-code called the sum of a and (B and we 
write 6 = a + (B. It is easy to show that this is a valid definition and 
does not depend on the particular generator matrices chosen for ft and (B. 
If A(Ct) and A(ffl) are parity-check matrices for « and (B respectively, 
then 

/A(a)i o \ 
A(e) = ! (7) 

V o :a((B)/ 

is a parity-check matrix for Q = Q, + (B. 

Transmission of a letter from e amounts to transmitting a letter from 
Q followed by a letter from (B. Because of the independence of the noise 
on the channel from one transmitted digit to the next,* it follows at once 
that if Qi(a), Qi((R) and Qi(e) (see Section 1.6, Ref. 1) arc the proba- 
bility of no error for codes a, (B and Q = a + (B respectively, then Qi(Q) = 
(Ma)Qi(cB). 

If C = a + (B, a generator matrix for e need not appear in the block 
form (6). A parity-check matrix for Q need not appear in the block form 
(7). The columns of a generator or parity-check matrix for 6, however, 
separate into two sets. All columns of the first set are linearly inde- 
pendent of all columns of the second set, and vice versa. Furthermore, 
if a linear combination of the columns sums to zero, the terms of this 
sum belonging to the first set separately sum to zero. The two sets of 
columns are said to be independent. (See Section 2.2 of this paper for 
further detail.) Since column dependences of a matrix are unaffected by 
premultiplication by a nonsingular matrix, we have that a code is equiva- 
lent to a sum of two codes if and only if the columns of its Q-matrices or 
A-matriccs separate into independent sets. 

Some readily established properties of the sum just defined follow: 

a ^ a' and (B ^ (B' implies a + (B ^ a' + (B'; (8) 

ft + (B ^ (fi -f fl; (9) 

a + (© + e) = (a + <b) + e ; (10) 

if e - e + (B, e + = a + + (B + . (li) 

1.5 The Product of Two Codes 

We first remind the reader of the definition and elementary properties 
of the direct or Kronecker product of two matrices. Let R = (r tJ ) be a 

* Whenever probabilities are discussed in this paper, the usual binary sym- 
metric channel is assumed. 
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matrix with a rows and b columns. Let S = («</) be a matrix with c 
rows and d columns. The Kronecker product T = R X S of R times S 
(the order of factors is important) is the matrix of ac rows and bd col- 
umns with partitioned structure 



T = R X S = 



r n S \ raS ; • • • ; »*»£ 

r2i<S : rnS : '■ r^bS 



r ai S ': r a tS 



TatS 



The rows and columns of T can be labelled by pairs of integers so that 
a typical element of T is Ui-.ki = rufijt ■ These indexing pairs are listed 
in dictionary order, so that ij precedes i'f if either i < i', or, when 
i = i', \Sj < f. For example 14 precedes 23, and 63 precedes 64. 

One readily establishes the following properties for the Kronecker 
product: 

Q X (R X S) = (Q X R) X S, (12) 



R X S = R X S, 
(P X Q)(R X S) = (PR) X (QS), 
RX S = a(SX R)p. 



(13) 

(14) 

(15) 

In (13), the tilde indicates transpose. In (14), it is assumed that the 
columns of P are equinumerous with the rows of R and that the columns 
of Q are equinumerous with the rows of S. The product PR indicates 
the usual matrix product. In (15), if R has a rows and b columns and 
S has c rows and d columns, then a and m are permutation matrices of 
dimension ac and bd respectively and these matrices depend only on the 
numbers a, b, c and d and not the entries of R or S. 

Let a be an (n,fc)-code and let (B be an (n',fc')-code. We define a new 
code C by 

o(e) = n(a) x o(cb). (16) 

The code C so defined is an (nn',kk')-code called the product of a and 
(B and we write e = G(B. It is an easy consequence of the properties of 
the Kronecker product that e so defined is an (nn'Jck') -code and does 
not depend on the particular generator matrices used for a and (B in 
(16). 
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From (12) through (15) the following properties of code multiplica- 
tion are readily established: 

d ^ a' and <B = ffl' implies ft(B ^ G'(B', (17) 

G(B ^ (BCt, (18) 

a((Be) ^ (a<B)e, (19) 

a((B + e) ^ ct(B + ae. (20) 

We note that (a(B) + is not equivalent to a f (B + in general. 

Let a, (B and e = «(B he respectively an (w,&)-, an (n',k')- and an 
(rm'.M') -code with generator matrices ft, £2' and Q," and parity-check 
matrices A, A' and A". There does not seem to be a simple expression 
for a parity-check matrix for e in terms of A and A'. However, if we 
confine our examination of codes to equivalences only, the structure of 
the parity checks for the product of two codes can be described simply. 

We may suppose, then, that Q and fi' are in ilf-form. The structure of 
Q," is then given, up to equivalences, by 

SI" = (I k \ M) X (J* . AT) 

(21) 
£* (I k X I k - h X 21/' ! M X /*' i M X M'). 

Denote the last mi' — /,/,' columns of this last matrix by N. Then 
(Inn'-kk' '■ N) is the parity-check matrix for a code equivalent to G. 

It is readily seen from (21) that a code Q' equivalent to e can be 
described as follows. The k' information places of (B are replaced by 
letters (w-place binary sequences) of the code a. This accounts for the 
kk' information places of e' and for the k'(n — k) check places of e' 
described by the block M X /*' in (21). The n' - k' parity checks of 
(B are then applied to these k' "information hyperplaces." The block 
h X M' in (21) describes repeated application of checks of (B over the 
first A" positions of the information hyperplaces of Q' and accounts for 
(n' - k')k checks. The block M X M' gives (n - k)(n' - k') addi- 
tional checks over the information places of Q'. 

lip to equivalence, the product of two codes can be described in an- 
other, perhaps more simple, manner. Let e = (2(B, where Gt is an (n,k)- 
code and (B is an (n',k') -code. Then e is equivalent to the (nn',H-')-code 
C' obtained as follows, a is equivalent to a code a' with k information 
places and n — k check places; (B is equivalent to a code CB' with k' 
information places and ri — k' check places. In both a' and (B', the 
check digits are mod 2 sums only over the information places. Write the 
kk' information places of e' in a rectangular array of k' rows and k 
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columns. Treat each row of the array as the k information places of a 
letter of ft' and affix the corresponding check digits to obtain k' rows 
each of n binary digits. Regard each column of the array as the k' in- 
formation places of a letter of (B' and affix to each column the n' - ft' 
corresponding (B' check digits. The nn' binary digits so obtained, read 
off in some fixed order, give the corresponding letter of &'. It is to be 
noted that, in this description of C, (n - k)(n' - k') of the check digits 
involve sums over other check digits, whereas in the description given 
by the last block of (21) these check digits are given as linear sums over 
the informal ion places only. 

l.n Arithmetic of Equivalence Classes 

The sum and product of group codes introduced in the preceding two 
sections provide an arithmetic of equi valence classes of codes. As before, 
let ft denote the equivalence class of codes to which the (w,A0-code ft 
belongs. We define the sum of two equivalence classes by 

a + (B = (ft + (B). 
The self -consistency of this definition follows from (8). Similarly we 
define a product 

M = a<$, 

which is seen to be consistent from (17). Equations (8) through (11) 
and (17) through (20) give at once 

d + (B = (6 + d, 

ct + ((B + &) = (ft + (B) + e, 

M = M, 

ft((B6) = (M)e, 

&((& + (3) = && 4- ft<3. 

The simple two-letter code, 1, consisting of the letters and I with 

parameters n = 1 , k = I and generator matrix Q = (1) has the property 

lft = ftl = ft, 
for all equivalence classes ft. 

1.7 Indecomposable Codes 

To avoid repeated cumbersome statements about trivial cases, in this 
section and the next we exclude from consideration codes whose generator 
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matrices contain columns of zeros. Such columns correspond to wasted 
digits in the code. A new code with smaller n value and the same k 
value can be obtained by deleting such all-zero columns. This property 
of possessing no columns of zeros is maintained under equivalence. If 
a possesses the property, it is not necessarily true, however, that a + has 
no columns of zeros. 

It may happen that an (w,fc)-code ft is equivalent to the sum of two 
or more codes. In this case, we call d deco?nposable. If a is not equiva- 
lent to the sum of two or more codes, we call G, indecomposable. 

If Q. is decomposable, all codes equivalent to (S are also decomposable; 
if a is indecomposable, all codes equivalent to a are also indecomposable. 
We can therefore speak of an equivalence class d of codes as being either 
decomposable or indecomposable according as its members are or are 
not decomposable. 

Theorem 2: Every (n,k)-code Q, is equivalent to a sum of indecomposable 
codes: a ^ <2i + a 2 + • • ■ + Cfc„, , where CLi , G 2 , • • • , Cfc,„ are indecom- 
posable. Furthermore, this decomposition is unique in the following sense. 
If also a £! a,' + Qo' + • • • + a,,/, where <fc' , G 2 ' , • • •, a,,/ are 
indecomposable, then m = m' , Q. x ^ a,,', G 2 = G,-,', • • • , Q, m = G, m ', 
where ii , i 2 , • • • , i m are the integers 1,2, • ■ • , m in some order. 

Theorem 2 can be stated in terms of equivalence classes as follows: 
Every equivalence class Q. of codes can be expressed as a sum of indecom- 
posable equivalence classes a = &i + Ct 2 -f ■ • • + a m . The indecompos- 
able summands (&i , (2 2 , • • • , Q, m are uniquely determined apart from order 
by A. 

A further consequence of Theorem 2 is 

Theorem 3 (cancellation law of addition): Let Q,, (B and G be any three 
equivalence classes of group codes. Then, if & + (6 = & + C, it follows 
that (& = C. (This theorem holds also when codes with columns of zeros 
are allowed.) 

1.8 Optimal Properties of Indecomposable Codes 

A useful property of indecomposable codes is stated in the following 
theorem. 

Theorem 4: Let Ctbe a decomposable (n,k)-code, k < n, with probability 
of no err„r Qi(Ct). There exists an indecomposable (n,k)-code, (?, whose 
probability of no error Qi((P) satisfies (?i((P) ^ Qi(&). 

In this theorem, Qi(tt) is the probability that a letter of a be decoded 
correctly when a maximum likelihood detector is used as the decoder 
(see Section 1.6, Ref. 1). A similar meaning holds for Qi((P). The 
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35 
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1 
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35 


47 
32 
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1 
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273 
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220 


847 
312 


361 
190 
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151 


79 
59 


61 

44 
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3749 
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4408 
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2484 
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1775 
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751 
465 


436 
266 


121 
96 


22101 
1794 


16749 
1700 


24297 
5632 


16749 
4875 


12616 
5098 


7240 

3689 


3557 
1948 


1503 
1041 


S7404 
4579 


72783 
4463 


143270 
26792 


113662 
24920 


102445 
37191 


72783 
31227 


34942 
17934 


20341 
12476 


350097 
11635 


311233 

11505 


901491 
137493 


784390 
132811 


957357 
320663 


784390 
293070 


428260 
213773 


311233 
175114 
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29091 


1.31126 
28946 


5.98528 
745413 


5.51748 
733654 


10.1746 
3.18608 


9.09877 
3.04662 


6.59254 
3.27631 


5.51748 
2.94948 


.70816 
70600 


5.44572 
70454 


41.1752 
4.14506 


39.2920 
4.11584 


119.235 
34.7994 


112.170 
34.0492 


123.425 
61.2716 


112.170 
58.0573 


2.9032 
164705 


22.2371 
164575 


287.813 
22.9827 


280.215 
22.9120 


1482.30 
397.232 


1434.04 
393.075 


2647.03 
1296.46 


2516.51 
1261.52 


0.6994 
366089 


89.0390 
365976 


2009.86 
124.432 


1979.34 

124.2HX 


18884.5 
4558.66 


18548.3 
4535.64 


76284.2 
29032.1 


59541.8 
28634.1 
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theorem thus states that the search for best codes can be restricted to 
indecomposable codes when "best" means large values of Q. 

Another criterion frequently used to evaluate codes is the nearest 
neighbor distance, d. This quantity is the smallest nonzero weight of 
the letters of the code. If d = 2e + 1, then the code can correct all com- 
binations of e or fewer digit errors in any transmitted letter. For a given 
n and k, it is not necessarily true that the code with largest d value has 
the largest Q\ value. 

The search for codes of largest nearest neighbor distance can also be 
limited to indecomposable codes as a result of 

Theorem 5: Let a be an (n,k)-code, k < n, with nearest neighbor dis- 
tance d(a). There exists an indecomposable (n,k)-code, (P, with nearest 
neighbor distance d{(P) ^ d(d). 

A convenient test exists for determining whether a given fi-matrix in 
i¥-form is the generator matrix of an indecomposable code. Two ele- 
ments, m T3 and ?n„, , of M are said to be connected if they both have 
value 1 and lie either in the same column or the same row of M. A 
path in M is a sequence of elements of M each of which is connected to 
its successor except for the last element of the sequence. In terms of 
these definitions, we have the following 

Test: Let a be an (n,k)-code with k < n. Then a is decomposable if 
and only if M contains a path containing elements from every row of M. 

The above test is meaningless for (n,n) -codes. The (1,1) -code is 
indecomposable. For n 5* 1, the O,w)-code is decomposable. 

It is easy to show from this test for decomposability that a is an 
indecomposable (>,/,•) -code with no column of zeros if and only if G + 
is indecomposable and has no column of zeros. 

The test for decomposability can also be used to establish that e = 
G(B is indecomposable if and only if a and (B are indecomposable. 

1.9 Enumeration of Equivalence Classes 

Although we have not succeeded in parametrizing the equivalence 
classes of (n,fc)-codes, we can systematically enumerate these classes by 
a modified Polya scheme. 3 The details of the method are given in Section 
2.8. Here we present the results of a computation. 

We shall denote by S„ k the number of equivalence classes of (n,k)- 
codes with no columns of zero. 

A generator matrix for an (n,fc)-code mayor may not have repeated 
columns. The multiplicities of columns in an S2-mat,rix are preserved 
under equivalence. Of interest are the (n,k) -codes whose fi-matrices 
have no repeated columns. We denote by S n k the number of equivalence 
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classes of (n,fc) -codes having no repeated columns and no columns of 
zeros. 

We adopt an analogous notation for the number of indecomposable 
equivalence classes. The number of equivalence classes of indecompos- 
able (n,A-)-codes with no columns of zeros is denoted by R nk . The num- 
ber of equivalence classes of indecomposable (n,k) -codes with no re- 
peated columns and no columns of zeros is denoted by R nk . 

Table I lists values of S nk , S nk , R nk and R nk . The box in row n and 
column k contains S nk in the upper left corner, S nk in the lower left 
corner, R nk in the upper right corner and R nk in the lower right corner. 
All entries are given to six significant figures. Numbers containing a 
decimal point are to be multiplied by 10°. 

From a table of values of S nk , one can easily construct a table of 
values of W nk , the number of equivalence classes of (n,k) -codes (zero 
columns and repetition allowed). Table II is a short table of values of 
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32 


97155 

77 


200787 
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97155 

77 
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N 
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511 
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43435 
43 


788035 
131 


3309747 
240 


3309747 
240 


10 


N 
11' 




1023 
10 


174251 
56 


6347715 
213 


53743987 
516 


109221651 
705 



1234 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1960 

W nk along with values of N nk , the total number of distinct (n,k) -codes. 
One has N„ k = N„i, W n k = W„i,l = n - fc. The familiar appearance 
of the first five rows of the Wnk table provides a good example of the 
perils of too hasty extrapolation in mathematics. 

Part II — ADDITIONAL THEORY AND PROOFS OF THEOREMS OF PART I 

2.1 Proof of Theorem 1 

Theorem 1 asserts that a necessary and sufficient condition for two 
/>• X n fi-matrices, say fi and 9,', to be equivalent is that their columns 
can be placed into a one-to-one correspondence that preserves mod 2 
addition of the columns. 

The necessity of the condition follows trivially from the fact that 
equivalence means gtta = fl' for some nonsingular g and some permuta- 
tion matrix a. For the one-to-one correspondence of the theorem, asso- 
ciate the t'th column of Slo, say c, , with the t'th column of fi', say c/, 
i = 1, 2, • • • , n. Then gd = c/, i = 1, 2, • • • , ft. Thus, if d + c, = 
c k , then gd + gcj = gc k , or c/ + c/ = c k '. Since g is nonsingular, it 
also follows that c/ + c/ = c k implies c, -f Cj = c k . 

To prove the sufficiency of the condition, suppose that the columns 
of Q and Q' can be placed into a one-to-one correspondence that preserves 
mod 2 addition of columns. Let a permute the columns of 9, so that the 
ith column of fi<r corresponds to the ith column of fl', t ■ 1, 2, • • • , ft. 
Let g € G k and (i,annX« permutation matrix, reduce Qa to M-form. 
Then mod 2 addition of columns is preserved between gSlaii and g&p 
when the ith column of the former is associated with the ith column of 
the latter, i = 1, 2, • • • , ft. The first k columns of gSlan are independent 
since the first k columns of gQa'p are. Therefore the matrix gx formed by 
the first k rows and fc columns of gQan is nonsingular. The matrix 
gr^gtlan is in Af-form and, when its ith column is associated with the 
z'th column of gQ'n, mod 2 addition of columns is still preserved. But 
then columns fc + 1, fc + 2, • • • , ft of these two matrices are identical 
linear combinations of their identical first fc columns, so that gr^Qap = 
gQ'n. It follows then that Q' = g- l gr l gSl<r, so that fi' and fl are equivalent, 

2.2 Decomposition of Sets of Vectors 

In this section we present five lemmas and a theorem concerning 
linear dependence of vectors. This material is preparatory for the proof 
of Theorem 2. While it is true that Theorem 2 can be proved much more 
directly (and abstractly) than is done here, it is felt that the procedure 
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to be followed gives more insight into the nature of the problem at hand 
than do the shorter more abstract proofs. 

Here we shall consider collections of vectors drawn with possible 
re-petitions from a finite dimensional vector space over a finite field of 
scalars. In the application to be made later, the vectors will be columns 
taken from the generator matrix of a code, and the scalars will as usual 
be zero or one. The reader may, if he wishes, restrict his considerations 
to vectors and scalars of this sort. Throughout this section, we agree to 
exclude the null- or zero-vector from consideration as a member of any 
of the collections of vectors we may discuss. 

Let &i , S 2 , • • • , S m be nonempty finite sets of vectors. Denote the 
vectors of S t by v,-> , j = 1,2, • • • , n , for i = 1,2, • • • , m. The sets 
Si , S 2 , • ■ ■ , S,„ are then called independent if every relation of the form 

m r,- 

EE«oV,; = 
i-l ;-i 



implies 



E^<; = 0, i = 1, 2, •••, m. 



Clearly, no vector in any one such set can be written as a linear combina- 
tion of vectors taken only from the other sets. Directly from the defini- 
tion of independence we also have 

Lemma 1: Let the sets Si be independent and let R { be a subset of St , 
i = 1,2, • • • , m. Then the nonempty sets among Ri , R 2 , • • • , R m are in- 
dependent. 

A set, S, of vectors is called indecomposable if S cannot be written as 
a union of two or more independent subsets of S. Every vector in an 
indecomposable set containing more than one vector can be written as 
a linear combination of other vectors in the set. Clearly, a set S that is 
not indecomposable is the union of independent indecomposable sub- 
sets, St , S 2 , • • ■ , S m . In this case we say that S can be decomposed 
into independent indecomposable components Si , S 2 , • • • , S m . 

A linear form / = a,Vi + a 2 v 2 + • • • + ajVj is called irreducible if no 
collection of j — 1 or fewer of the terms c*iV, , a 2 v 2 , ■ • • , <xjVj sums to 
zero; otherwise, the linear form is called reducible. Two linear forms are 
called disjoint if the respective sets of vectors with nonzero coefficients 
in the two forms are disjoint. We have then 

Lemma 2: Every reducible linear form that is equal to zero is the sum of 
disjoint irreducible linear forms each of which is zero. 

Proof: Suppose / = «iVi + a 2 v 2 + • • • + a>Vy to be reducible where 
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all the a's are different from zero. Then there are subsets of terms of I 
that add to zero. Choose such a subset containing a minimal number of 
terms and call the sum of these terms the linear form h . The form k 
must be irreducible or it would not contain a minimal number of terms. 
Repeat this procedure for I - k m k = 0. After a finite number of 
steps we obtain an irreducible form U and I = k + k + • • ■ + U • The 
forms so obtained are disjoint by construction. 

Let S contain r vectors. One can form p r - 1 linear forms 

r 

1 

of these vectors where not all the a's are zero. Here p is the number of 
elements in the field of scalars (p = 2 in the applications to follow). 
From this list of linear forms, delete those that do not sum to zero. 
From the remaining forms, delete those that are reducible. One arrives 
then at a uniquely determined set £ of irreducible sums, each one of 
which is zero. Two vectors of S, say v x and v 2 , are said to be directly 
connected to each other if they appear together as terms in any one of 
the irreducible sums of £. A vector of S not appearing in any of the 
linear forms of £ is said to be directly connected to itself. Two vectors of 
S, Vi and v 2 , are said to be connected if there exist vectors 

of S such that Vj is directly connected to v,-, , v,-, is directly connected 
to v 2 and v, a is directly connected to v, Q+1 , a = 1, 2, • ■ ■ , q — 1. 
If Vi is connected to v 2 , we write Vi ~ v 2 . Evidently, for all vectors 
vi , v 2 , v 3 of S we have: (a) Vj ~ v x ; (b) Vi ~ v 2 implies v 2 ~ v, ; 
(c) if Vi ro v 2 and v 2 ~ v 3 , then v x ~ v 3 . The vectors of S are therefore 
uniquely separated into disjoint equivalence classes by the connectedness 

relation ^. 

Lemma 3: The totality of vectors of S belonging to an equivalence class 
E of connected vectors forms an indecomposable set. 

For, suppose E could be written as the union of two independent sub- 
sets Si and »S 2 of E. Since all elements of E are connected, there must 
be a Vi in Si and a v 2 in S 2 such that v x is directly connected to v 2 . There 
is therefore a linear form in £ of the form 

t 

«lVi + Ot 2 V 2 + J2 a iVi = 

3 

with on t* 0, a 2 ?* 0. By the definition of independence, the terms in 



SOME FURTHER THEORY OF GROUP CODES 1237 

this sum belonging to Si add to zero, as do the terms belonging to S 2 . 
But this contradicts the irreducibility of sums in <£. 

Lemma .j: Distinct equivalence classes Si , S 2 , •••, S m of connected 
vectors of S are independent sets of vectors. 

Proof: Consider any linear form 

of vectors of S that is zero. Suppose I contains vectors from different 
equivalence classes with nonzero coefficients. Then, since I = 0, I can- 
not be irreducible, for in this case the vectors in different equivalence 
classes would be directly connected. Since it is reducible, I can be written 
by Lemma 2 as the sum of disjoint irreducible forms each of which is 
zero. But none of these forms can contain vectors from different equiva- 
lence classes. Adding together all the irreducible forms containing 
vectors from any one equivalence class, we get 



2 «*,▼« = 0, i = 1, 2, 



m. 



Lemma 5: All vectors of an indecomposable subset P of S belong to the 
same equivalence class of connected vectors. 

For, let Ri be the set of vectors of P that belongs to the equivalence 
class Si, i = 1, 2, •••, m. By Lemmas 1 and 4, the sets Ri are 
independent and the assumed indecomposable set P is then exhibited 
as the union of independent subsets. This is a contradiction unless all 
the Ri but one are empty. 

The preceding lemmas and definitions allow us to state finally the 
following 

Theorem 6: A set S of vectors can be decomposed into independent in- 
decomposable components in oidy one way. 

Proof: We have seen that S can be separated into equi valence classes 
of connected vectors in a unique manner. Lemmas 3 and 4 show these 
equivalence classes to be a decomposition of S into independent inde- 
composable sets. Suppose now that S could be decomposed in another 
manner into independent indecomposable sets. Lemma 5 shows that each 
such indecomposable set is completely contained in an equivalence class. 
There cannot be more than one such indecomposable set in any equiva- 
lence class, for then the equivalence class would be the union of two or 
more independent subsets which contradicts Lemma 3. 

We point out once again in closing this section that the vectors of the 
set S here considered need not be distinct. S may contain several copies 
of a single vector of the linear vector space under consideration. 



1238 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1960 

2.3 Proof of Theorem 2 

Let us regard the columns of a generator matrix Q( G) as a collection 
of vectors. The linear relations satisfied by a set of vectors determine 
whether or not the set is indecomposable. The linear relations satisfied 
by the column vectors of generator matrices of equivalent codes are 
identical (except for possible renumbering of the columns). It follows 
immediately that a code a is indecomposable if and only if the columns 
of any (and hence every) generator matrix ft(Ct) form an indecompos- 
able set of vectors. With this remark, we proceed to the proof of Theorem 
2. 

That every (w,fc)-code a is equivalent to a sum of indecomposable 
codes follows readily from the definitions of indecomposable codes and 
equivalence. Here we show only that if 6, = di + 6-2 + ■ • ■ + G*> and 
a = Q,i + G 2 ' + • • • + Q-m-' where the a, and 0/ are indecomposable, 
then m = m' and a> S a,/, j =■ 1, 2, • • • , m, where ii , i 2 , •■-, i m are 
the integers 1, 2, • • •, m in some order. 

If R, S, • ■ • , are matrices of respective size r X r', s X s', ■ • ■ , we 
denote by diag (R, 8, • ■ • ) the (r + s + • • • ) X (r' + s' + • ■ • ) par- 
titioned matrix having R in its first r row and r' columns, S in rows 
r _j_ 1 t0 r _|_ s an d columns r' + 1 to r' + s', etc., and zeros elsewhere. 
Set 

q = diag [n( a,), 0(02), ■•■,o(a«)] > 

12' = diag [0( a,'), 0(02'), ■••,0(Ct*' / )]. 

Then, by hypothesis, ft = pOV, where a, is an indecomposable (n,- , />•;)- 
code, t = 1, 2, ■ ■ -,m; 0/ is an indecomposable (n/,fc/)-oode, j = 1, 2, 
• • • , ra' ; and 

m m' 

z-i fa = 2_/ fa -/ = ' c > 

m m' 

The columns of £2 decompose into independent indecomposable sets 
Si, S 2 , • ■ • , S m . Here Si consists of the first rii columns of ft, aS 2 con- 
sists of the next n 2 column of ft, etc. The columns of Of a satisfy linear 
relations identical with those satisfied by the columns of ft since ft = 
gQ'a, and hence, from Theorem 6, the first ni columns of ft'<r are an in- 
decomposable set &', the next n 2 columns of Q/a are an indecomposable 
set S 2 , etc., and these sets are independent. But the columns of Q/a 
are a reordering of the columns of ft' and the latter are exhibited as m' 
independent indecomposable sets in (22). Therefore, m = m' and n,/ = 
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n i }j = 1, 2, • • •, m, where i\ , U , • ■ •, i m are the integers 1, 2, • • ■, 
m listed in some order. It follows then that S/ consists entirely of those 
columns of Q' that contain Q(Oi/),j = 1, 2, ■ ■ ■ , m. We can then write 
12' 'cr = /i!2", where n is a k X k permutation matrix, 

0" = diag [0(G fl % , 0(0,,% , • ■ •, ti(a im ')* m ], 

and vj is an w,- X n,- permutation matrix,.;' = 1,2, • • •, m. On setting 
gr" = gn, we have 0"12" = 12. 

Let 7\ be the matrix of the first ni columns of 12, T 2 be the matrix of 
the next n 2 columns of 12, etc. Let TV' be the matrix of the first nj col- 
umns of 12", T 2 " be the matrix of the next n^ columns of 12", etc. Then 
g"T/' = Tj,j = 1, 2, •••, m. But Tj is of rank kj and g" is non- 
singular, so that Id/ ^ kj . From £ fc/ = X) &i = fc, we find k t / = 
kj,j = 1, 2, •••, m. 

Now partition (7" in rows according to /r, , A- 2 , • • ■, fc m and in columns 
according to ni , rc 2 , • • • , n m . Denote the ith diagonal submatrix of g" 
by </,- . Then ftf = 12 yields g j Q(a i /)a j = Q(a,),j = 1,2, • • •, m. 
A comparison of ranks in these equations shows that the g, are nonsingu- 
lar. Therefore G ; - S G./,./ = 1, 2, •••, m, and the theorem is 
proved. 

2.4 77ic Test for Indecomposabilitij 

We have seen that an (n,A-)-code a is indecomposable if and only if 
the columns of any generator matrix 12(a) are an indecomposable col- 
lection of vectors. If Q(Ct) is in M-form its first k columns are inde- 
pendent and each contains a single one. The other columns of 12(a) can 
each be expressed as an irreducible sum of these first k columns. From 
Section 2.2 it follows that the columns of 12(a) will form an indecompos- 
able set of vectors if and only if the first k columns of 0( a) are connected 
to each other. The reader can readily translate this statement into the 
test described in Section 1.8. 

2.5 Proof of Theorem 3 

The hypothesis a + (6 = d + e means that, for codes a, (B and e 
respectively in a, (6 and e, 

a + <b ^ a + e. 

Then 

a, + a, + • • • + a„ + «i + (B 2 + ■ • • + (& p 

S a, + a 2 + • • • + a a + e, + e 2 + • • ■ + e 7 , 
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where the ft; , <B, and 6,- are the (unique) indecomposable code com- 
ponents respectively of a, (B and e. By Theorem 2 we have fi = y, 
and there is a one-to-one correspondence set up by the equivalence re- 
lation S between elements of the set Hi = [di , ■ • • , G« , ®i , ■ • • > ©0} 
and the set H 2 = { a, , • • ■ , a a , 6, , • • • , C,} . If all the OVs map into 
6's in this correspondence, then £ ®* = L e « ,<& = $, an d the 
theorem is proved. Suppose then that (B, maps into a,-, of H 2 . If a tl of 
i/ x maps into a e, say Ci , then (Bi £ G„ ^ e x , and we go on to ex- 
amine another <B of Hi . If, however, a,-, of Hi maps into a,-, of H 2 , 
we then consider a, 2 in #i . Proceeding in this manner, we must ul- 
timately reach an a in Hi that is mapped onto a 6, since the G's in 
Hi and 7/ 2 are equinumerous and (Bi of H t is mapped onto an a of H 2 . 
This yields a chain of equivalences starting with (Bi and ending with a 
6. Each (B then is equivalent to a e and, by reversing the argument, we 
find a one-to-one equivalence correspondence among the (B's and 6's. 
It follows then that (fi = 6. 

2.6 Proof of Theorem 4 

Theorem 4 states that if Ct is an indecomposable (n,k) -code, k < n, 
with probability of no error Qi(tt), then there exists an indecomposable 
(n,fc)-code, (P, with probability of no error Qi((P) ^ Qi(«)- 

IVoo/; The given code a is equivalent, by Theorem 2, to a code a' 
that is the sum of indecomposable codes: 

a' = <Bi + (& + • • • + «»■ , 

where (Bi is an indecomposable (n,- , A-,-)-code and 2J^ = k, Z-< n »' = n - 
Let (B, have probability of no error Qi((B») when used with a maximum 
likelihood detector. Then a' has probability of no error Qi(a') = 
Qi(<Bi)Qi((B2) • • • Qi((B»). [See remark following (7).] 

We shall show below that the theorem is true for m = 2. The proof 
for general m then follows readily by induction. For, suppose the theo- 
rem to be true for m = 2, 3, • ■ ■ , r. If then a' = (Bi + (B 2 + • ■ ■ + (B r + 
CBr+i , by the induction hypothesis there is an indecomposable 
( n _» r+1 ,fc-fc H . 1 )^de(B'withQi(<B') ^ Qi((Bi)Qi(fflf) ••■ Qi(<B r ). 
The decomposable code a" = <B' + (B r+ i has probability of no error 
Qi(a") = Qi((B)Qi(©r+i). Again by the induction hypothesis, there 
exists an indecomposable (n,fc)-code, (P, with Qi((P) ^ Qi(G") = 

<?i(<B')<?i«Br+i) ^ Qi((B,)Q,((B,) ••• <M<B,)(M(B r+ ,) = <M«'). The 
theorem is then true also for m = 2, 3, • • •, r + 1. 

To prove the theorem for m = 2, we distinguish two cases. First sup- 
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pose n 2 j£ 1. We can suppose the generator matrices for (Bi and (B 2 
written in il/-form so that a generator matrix for a' has the form 



/ /*, i M i : • \ 

o(tt') = ; ; ; 

\ i : /, 2 ; Mt J 

Consider now the (n,A-)-code (P with generator matrix 



(23) 



Q((P) = 



: : : 11 — 1 

T : ,, : A : 00—0 

/*, : il/i : : . . . 

: : : 00-0 











M, 



(24) 



where the upper right section of ft( (P) has one row of l's and ki — 1 rows 
of zeros. We observe first that (P is indecomposable, since (P is equivalent 
to a code with generator matrix in A/-form with 



M = 



: 11 — 1 
M X \ »"■? 

: 00---0 







M, 



Since (Bi and <B 2 are indecomposable, both Mi and M« have paths that 
contain all their rows, by the test of Section 1.8. A single path contain- 
ing all rows of M is then easily obtained by joining together the paths 
for Mi and M 2 by some of the ones of the upper right block of jl/. The 
code associated with M is thus indecomposable, and so is (P. 

The last /.i — 1 rows of ft(*i) generate an (m , In — l)-code. Let the 
letters of this code be B n ', B 12 ', ■■-, Bj , where a = 2* l ~\ Let the first 
row of Q((Bi) be denoted by B u . Then the mi = 2* 1 letters of 03i are 
B u ', B v /, ■■-, Bj and B u + B u ', B n + By/, ■ ■ , B n +B la '. Let the 
letters of (B. be B 2i , B,, , • • • , B 2 ^ where n-> = 2 k - . Then the letters of 
Ce' can be denoted by the^i/^ symbols (B u ', B 2j ) and (Bn + B u ', B 2 j), 
where i = 1,2, • • ■ , a and j = 1,2, ■ ■ • , y. 2 . The notation here is that 
(Bu, B 2j ) stands for the sequence B u ' followed by the sequence B 2j , 
for example. 

In the notation just introduced, the M1M2 letters of (P are (Bu , B 2i ) and 
(B n + Bd , B 2j ), where i = 1,2, • • •, a and j = 1, 2, • • •, M2 and B 2j 
denotes the sequence B 2j with its last n 2 — k 2 = h places complemented. 
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That is, B 2j is obtained from B 2i by changing to zero every one in the 
last k places of B 2j and by changing to one every zero in the last l 2 
places of B 2 j . 

Consider now transmitting with (P over a binary symmetric channel 
using the following decoding rules. Apply the maximum likelihood de- 
tector for (Bj to the first n x digits of a received sequence R. One thus 
obtains a letter of (Bi , say B u . If B u is one of the letters B n ', B 12 , • • • , 
B u ', apply the maximum likelihood detector for (B 2 to the last n 2 places 
of R to obtain a letter of (B 2 , say B 2j . The pair (B u ,B 2j ) is taken as the 
decoded version of R. If.however, Bu is one of the letters B n + B n ', 
B n + Bn , • • • , Bu + B lt ', complement the last h places of R, and 
then apply the maximum likelihood detector of (B 2 to the last n 2 digits 
of this new sequence derived from R. A letter B 2j , say, of (B 2 will be 
obtained. The decoded version of R is taken to (Bu , B 2j ). 

It is readily seen that on using the indecomposable code (P with this 
decoding scheme, the probability of no error is Qi((Bi)Qi((B 2 ). Since the 
maximum likelihood detector for (P must do as well, Qi((P) ^ Qi(®,) • 
Qi(& 2 ) = Qi(G') = (M&)> an d tne theorem is proved for this case. 

If n 2 = 1, but ni ?* 1, reverse the roles of (Bi and (Ba in the preceding 
argument. The case n x = n 2 = 1 has been excluded by the condition 
J: < n, for rii = n 2 = 1 implies A-, = k 2 = I, or n = k = 2. 

This completes the proof. 

2.7 Proof of Theorem 5 

The nearest neighbor distance, d(a), of a group code ft is the 
smallest of the nonzero weights of the letters of a. If a and a' are 
equivalent, d(Q) = d(a'), and indeed the list of weights of letters of a 
is the same set of numbers as the list of weights of the letters of a'. It 
is easy to see that if a = (B + e then d(a) = min [rf((B), d(C)]. 
Thus, if a £ (Bi + (B 2 + • • • + (B m , d(tt) = min [d((B,), d((B 2 ), • • •, 

d«B„)]. 

The proof of Theorem 5 follows the outline of the proof of Theorem 4. 
The inductive part of the proof only requires substituting d's for Q's. 
The pertinent equations are : 

d((B') ^ min [<*(©,), d(<fc), ■ • -, d((B r )], 
d(a") = min[d((B'),rf(«r+i)], 
d((P) ^ rf(a") = min [d(($>'), d((& r +i)] 

^ min{min [rf((B,), • ■ -, d((B r )], rf(03 r+1 )} 
= min [d(CBi), • • •, d((B r+ ,)] = d(Ct') = d(a). 
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To prove the theorem for m = 2, we again consider a generator matrix 
for a' in the form given by (23). Without loss of generality, we suppose 
d(a') = d((Bi), so that d((Bi) ^ d((B 2 ). Now suppose l 2 = n 2 - k 2 ^ 1. 
We compare ft' with the indecomposable code (P given by (24). The 
nonzero letters of (P are the 2 k|+ * 1 — 1 nontrivial linear combinations 
of the rows of Q((P). Every such linear combination that contains one 
or more of the first fci rows of ft((P) has weight ^ d(©i), since the first 
?h places will be a nonzero letter of 03i and the last rc 2 places have weight 
^ 0. Every linear combination of rows of ft((P) that does not contain 
any of the first hi rows is just a letter of (B 2 preceded by n x zeros, and 
hence has weight ^ rf((Ro) ^ d{(S> x ). We thus have d((P) ;> d((Bi) = 

d(a'). 

If l 2 = 0, then k 2 = n 2 = 1, since (B 2 is assumed indecomposable. 
Thenrf((B 2 ) = 1 and, since (/((Bi) g d(® 2 ),d(a') = di^) = 1. How- 
ever, for every indecomposable (n,A-)-code <p, we have d((P) ^ 1 = 
d(Qf), and so the theorem is proved for m = 2. 

2.8 Enumeration Formulae 

Let G be a finite group with elements g 1 , g 2 , ■ • ■ , g r , where r is the 
order of G. Define g { ~ gj if there exists an element g £ G such that 
0. = 99j0' 1 - The equivalence relation ~ partitions G into equivalence 
classes C\ , C 2 , • • • , C„ called classes of conjugate elements. Now suppose 
that, corresponding to each element g { of G there is a permutation, 
<r(gi), of m objects Si , S 2 , • • • , S„, of a set S such that if g^ i = g k , 
then a{gi)a{gj) = a(g k ). We define two of the objects of the collection 
S, say Si and Sj , to be equivalent if there is a <r(g t ), gi 6 G, that re- 
places Si by Sj . The collection of objects S is then partitioned into 
equivalence classes. A well-known theorem (p. 231, Ref. 3) gives, for 
the number of equivalence classes JV of S, 

N = - r Z niCMd). (25) 

Here n(d) is the number of elements of G in the equivalence class C, 
and x(C\) is the number of elements of S left invariant by any <r(gi), 
gi 6 d . [It is easy to show that if g t ~ gj , then oUji) and <r(0,) leave 
the same number of elements of »S' invariant.] 

We apply this theorem to the enumeration of (/*,A-) -codes as follows. 
For the group G we choose the collection G k of nonsingular k X k mat- 
rices (mod 2) of order 

| G k | = (2*- - 2°)(2* - 2') • • • (2* - 2 fc -\). (26) 



1244 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER I960 

Let Vi , v 2 , • ■ • , v 2 fc_i be the nonzero fc-place binary column vectors. 
For the sets & , & , • • • , Sm we choose the m = (2* - l) n possible 
collections of the v's taken n at a time (repetitions of v's within any S 
allowed). The elements of G k permute the 2* - 1 vectors v among them- 
selves by ordinary matrix multiplication. That is, if giVj = Vi , we say 
that gi induces a permutation n(g<) that replaces v y by Vt . The permu- 
tation n(g t ) of the v's in turn induces a permutation a{g t ) of the sets 
Si S 2 , • • • , 8» . We note that if n S 2 fc - 1, then 



m — 



(';') 



of the m S's have the property of containing only distinct vectors (no 
repetitions), and these m special S's are permuted among themselves 
under a{g t ). We denote by a(gd the permutation of these fh special 
S's induced by gi . 

We now define two k X n binary matrices ft and ft', regardless of their 
rank, to be equivalent if there exists ag € G k and an n X n permutation 
matrix v such that ft' = gttv. The number of equivalence classes of 
k X n-matrices none of which has columns of zeros is then clearly the 
same as the number of equivalence classes of the sets Si , • ■ • , S m . Ap- 
plying (25), we write 

ru-rill^)x(Ci), (27) 

I (rt | i 

r rt -TinL»<0«>*<<Wi (28) 

where | G* | is given by (26), n(d) is the number of elements of G k in 
class d , and x(d) and x(C) are the number of objects left invariant 
respectively by a(gi) and *(?<), 0, € C«. The quantities T„ fc and f „* 
are, respectively, the number of equivalence classes of k X n matrices 
with no columns of zeros and the number of equivalence classes of 
k X n matrices with no columns of zeros and no repeated columns. 

The matrices ft in the above enumeration may have rank less than 
k. It is easy to show, however, that 

Snk = Tn,k- 7\a-i, (30) 

8nk= Tn,k~ Tn,k-l, (31) 

k = 2, • - ■ , n, n = 1, 2, • • • , where, as in Section 1.9, S nk and 
Snk are, respectively, the number of equivalence classes of (n,fc)-codes 
with no column of zeros and the number with neither repeated columns 
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nor columns of zeros. We also have *S„i = 1 for n = 1,2, • • • and 
&i = l,£„i = Oforn > 1. 

The group G, : has been well studied, and (he detail needed to evaluate 
(27) and (28) can be taken from the literature. Here we omit all deriva- 
tions and only present such definitions and formulae as needed for our 
purpose. The structure of Gk is given in detail by Dickson; a recipe for 
getting the cycle structure of the permutations of the v's induced by ele- 
ments of Gk is given by Elspas. J 

A polynomial of degree d > 0, 

P(x) = x + ai./~' + a^x 1 " 2 + • • • + a d , 

where the o's are zero or one, is said to be irreducible if it cannot be 
written as the product of two or more polynomials with coefficients zero 
or one, where each factor is of degree greater than zero. (All addition of 
coefficients is to be done mod 2.) For each d there are a finite number of 
irreducible polynomials. In what follows, we shall exclude from con- 
sideration the irreducible polynomial P(x) = x. The first few irreducible 
polynomials are x + 1 , x 1 ■+- x + 1 > X 3 + x + 1 , x* + x 2 + 1 . A more 
comprehensive table of irreducible polynomials is given by Church, 1 ' 
where, for each irreducible polynomial, P, there is also listed the small- 
est integer e such that P divides x e — 1. We suppose the irreducible 
polynomials to be numbered, and denote them by Pi , P 2 , P 3 , ■ ■ • . We 
let di denote the degree of Pi and e,- denote the smallest integer c such 
that Pi divides x* — 1. We further let t d be the number of irreducible 
polynomials of degree d or less. 

A partition of an integer a into positive integral parts Xi , X 2 , • • • , 
say a = Xi + Xa + • • • + X p , can also be written in the form 



= 1«1 + 2«o "T" * " * "T* aa a = Z_j l* 



ICti . 

Here a, designates how many parts have the value i. We shall use bold- 
face Greek letters to denote partitions. The absolute value sign will de- 
note the value of the integer being partitioned. For example, « will de- 
note a particular partition, 

a 

i 

of the integer a = \ a |. When dealing with many partitions d , o 2 , a 3 , 
etc., we shall denote the numbers of parts of various size of a,- by an , 
an , etc., so that 

I «•' I = 2 3<*ii • 
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We admit the single partition of zero, 0, into one part. For this partition, 
all a's are zero. 

The classes of conjugate elements of Gk can be specified conveniently 
by /*-place symbols. The fth place in such a class symbol corresponds to 
the i\h of the irreducible polynomials of degree % fe. Each place in such 
a class symbol is occupied by a partition. If the symbol for a class of G k 
is 

(a, , a : , ■ • • ,a, k ), (32) 



we require 



Z I «. ■ I di = fc. (33) 



The various classes of G k are given by all the distinct symbols (32) that 
can be formed subject to (33). The sums in (27) and (28) are over such 
class symbols. 

We now give a recipe for the integers n(C) of (27) and (28). (See 
p. 235, Ref. 4.) We first write 



n(C) = 



G k 



D(cy 

Then, if C is specified by (32), 

D(C) = n/(«i,dy). 



Here 



where 



f(* it j) =2* ( «< ) fi'n(««,i). 



/ =i 



and 



fi (^) = (2- - 2 0i )(2 ri - 2 U ) • • • (2 ri - 2 (r " 1)i ) 

\Ui\ |«<J^-1 \Oi\ 

6(a,) = Z a { f(j - 1) + 2 £ jau Z «*i • - 

To compute the quantities x(C') and x(C»0 o f ( 2 ?) and ( 28 )' we 
need to know the cycle structure of the permutation of the v's induced by 
an element of class d of G h . Let an element of C\ , as given by (32), 
permute the v's into v { cycles of length i, where i = 1, 2, • • • , 2 — 1. 
An algorithm for finding the v's is given by Elspas. 5 Introduce indeter- 
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minates z x , z 2 , ■ ■ ■ , and define the product of two z's by the rule 

Z a Zb = CZd , 

where c is the greatest common divisor of a and b and d is the least 
common multiple of a and b. Then the v's may be obtained from 

2*-l tk \«j\ 

«i+ l n(c)fi- ii n ff(i,y)«ii, 

where the linear forms H(i,j) in the z's are obtained recursively by 

ndiU—l)/ndi i \ 

H(i,J) = H(i,J - l) + f y_ iii.y, 

t - 1, 2, ■ ■ • , 

ff.i = e,-2 6j ', 

where &,■ is the smallest integer such that 2 h > ^ j, and H(i,0) = z t ,i = 1, 
2, ••• 

An element of Gk permutes the v's hi cycles. A collection Sj of n v's 
will remain invariant under this permutation only if Sj is composed of 
complete sets of the v's that are permuted hi cycles. It is not hard to 
determine the number of Sj that remain fixed when the cycle structure of 
the permutation of the v's is given. We write only the final result: 

E T nh f = i z n(o n (1 - tr yjiCi) , 



G k 



2*-l 



Z ^n*« B = r^En^) II (1 + <T' (Cl) . 

I VJfc I i i=l 

The utterly formidable series of formulae and algorithms from (32) on 
were used, along with (30) and (31), to compute the S nk and *§„* given 
on Table I. The R,a were found from the S a k by a generating function 
scheme which will not be described in detail here. When the R nk are 
known for k = 1, 2, • • ■ , k Q and n = 1,2, • • ■ , n , these numbers can 
be used to find the number of equivalence classes of decomposable 
(no + 1, ko) -codes, (n , h + 1) -codes and (n + 1, A'o + 1) -codes. By 
subtracting the number of decomposable equivalence classes from the 
appropriate S n k , new values of R„k are found. 

The programming of these formulae for the IBM 704 presented a 
number of interesting problems. All quantities involved are integers. In 
the program, they were maintained as integers. The division indicated in 
(27) then provides a check as to the accuracy of the sum. Unfortunately, 
the integers involved are frequently enormous. Modest answers in Ta- 
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ble I of magnitude 10 1 to 10 2 were obtained as the result of computations 
involving integers of magnitude 10 30 . The total machine time needed to 
compute the results presented was about 45 minutes. 

2.9 An Alternate Approach to Enumeration 

In Ref. 1 we regarded any subgroup of order 2 k of the group B„ of 
n-place binary sequences under mod 2 addition as an (n,/c)-code. Thus 
codes with columns of zeros were admitted. It was also pointed out that 
G„ is the group of automorphisms of B n . If we regard the elements of 
B„ as column vectors, then multiplication of each element of B„ by an 
n X n matrix g 6 G„ sends the element into a new element of B n and 
this defines the automorphism associated with g. 

In an automorphism of B n , subgroups of B„ are sent into subgroups. 
We denote by g(Z the subgroup into which the (n,/c)-code a is sent under 
the automorphism g. As g runs through G n , gCL runs through all N„ k (n,k)- 
codes. 

Now let H be the subgroup of G„ that leaves a invariant, i.e., H con- 
sists of all those elements g £ G„ for which g(Z = a. Let S„ be the sub- 
group of G n consisting of all n\ n X n permutation matrices. Then the 
elements S„H (the collection of distinct elements of G„ obtained by 
multiplying every clement of S n on the right by every element of H) send 
a into an equivalent code, and it is easy to show that S„H contains all 
elements of G„ that send a into an equivalent code. Let g 2 £ G n send a 
into a nonequivalent code a 2 . Then g, $ S n H. Every element of the 
collection S„g 2 H (i.e., all elements sg 2 h with s € S n ,h £ H) then sends 
a into a code equivalent to G 2 , and a gam it is easily shown that every 
element of G n that sends Q, into a code equivalent to a 2 is contained in 

S n gtH. 

A collection of the form S„gH is called a double coset of G n with respect 
to Sn and H. Two double cosets of G„ with respect to S n and H, say 
S„giH and S„g 2 H, are either disjoint or identical. The group G n can thus 
be decomposed into disjoint double cosets S n giH, S„g 2 H, • • • , S„g„H. 
The argument of the preceding paragraph can be continued to show that 
p, the number of double cosets of G H with respect to S„ and H, is the 
number, IF,,* , of equivalence classes of (n,k) -codes (zero columns per- 
mitted). 

The following formula 7 for the number, p, of double cosets of a finite 
group G of order | G \ with respect to the subgroups Hi and H 2 respec- 
tively of order | Hi | and | H 2 |, 

\G\ ^ ni( C t )th(Cj) /„ 4 x 
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could then be applied to the case at hand to compute W„k ■ In (34) the 
sum is over the classes C,- of conjugate elements of G, n(C») is the num- 
ber of elements of G in class C, , and n>(C\) is the number of elements 
of Ci that lie in Hj ,j = 1, 2. An appropriate choice for (X in the enumer- 
ation in question would be the (n,fc)-code whose last n — k columns are 
zero. The set of all matrices of G n whose last n — k rows contain only 
zero in their first /«• columns then makes up the subgroup H. We do not 
carry out the details of the enumeration by this method further here. 



2.10 Equivalence for M-forms 

We have commented in Section 1.2 that two equivalent 12-matrices 
both in il/-form may have different A/ -mat rices. It is natural to inquire 
into the different Af -forms possible for 12-matrices within an equivalence 
class.* 

The M -forms of all matrices equivalent to 12 can be obtained as fol- 
lows. Make any permutation of the columns of 12 that causes the resultant 
matrix, 12', to have its first k columns linearly independent. Premultiply 
12' by the inverse of the matrix formed by its first k columns. 

Now let 



12 = 



100 ,,- m n m~i2'" w-u 

010' "0 W2lWl22 ,,- W2J 

000- -1 mk\m k 2""niki 



= (h':M), 



where I = n — k. The permutations of the columns of 12 that replace its 
first k columns by independent columns can be generated by repeated 
applications of three types of elementary permutations: (a) interchange 
of position of two among the last / columns of 12; (6) interchange of posi- 
tion of two among the first k columns of 12; (c) interchanging one of the 
first k columns with one of the last / columns. A type (a) transposition 
is a column transposition of M and 12 is still in il/-form. A type (b) 
transposition involving columns i and j yields a matrix that can be 
brought into M-form by premultiplication by the permutation matrix 
that interchanges rows i and j. The new J\I differs from the old only by 
interchange of rows i and j. A type (c) transposition, which interchanges 
column j of M with column i of Ik , is valid only if w.j = 1 (otherwise 
the first k columns of the new 12 would not be independent). Let such a 
transposition send 12 into 12'. Let column j of M have ones in rows i, pi , 
p 2 , • • ■ ,Vr Jina " zeros elsewhere. Then 12' can be brought into M-form 

* The equivalence described here has been investigated independently and in 
a more general setting by Tucker. 8 
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by premultiplication by a matrix that adds row * of ft' to rows pi , p 2 , 
• • • , p r . The new M -matrix is then obtained from the original M-matrix 
by these operations: leave column j unchanged; except in column j, add 
row i to rows Pi , pa , • • ■ , Pr • We call this a -pivotal operation on M about 
the position m {j , provided m,j = 1. 

Define two M-mat rices to be equivalent if one can be obtained from 
the other by repeated applications in any order of permutations of rows 
or columns or by pivotal operations. Then two fl-matrices are equivalent 
if and only if when reduced to M-form their M-matrices are equivalent. 
Equivalent M-matrices, when prefixed by a unit matrix, yield equivalent 
ft-matrices. We have not been able to find a systematic method of reduc- 
ing a given k X I binary matrix to a canonical form by means of pivotal 
operations and permutations of rows and columns. 

2.11 Miscellaneous Comments and Problems 

The Q for the sum of two codes is the product of the Q's for the sum- 
mands. What is the relationship for the Q of a product in terms of the 
Q's of the factors? What is the relationship between the Q of a code and 
the Q of its dual? Answers to both of these questions probably require 
some detailed knowledge of the structure of the codes involved beyond 
a mere statement of their Q's. What detail must be known? 

Decomposition of codes with respect to addition has been explored. 
Certain optimal properties of indecomposable codes and a unique de- 
composition theorem have been proved. Decomposition with respect to 
multiplication can be defined in a similar manner. Do analogous the- 
orems hold in this case? 

When n < 2 k - 1, an fl-matrix need not have repeated columns. If an 
indecomposable Q-matrix does have repeated columns, the correspond- 
ing code can be viewed as having several check digits that are identical 
linear combinations of the information places. Intuitively, this seems 
like a wasteful use of the check digits. Is it possible to prove a theorem 
to the effect that if n < 2* - 1, there is an (n,A-)-code with no repeated 
columns with a Q as great as that for any (n,k) -code with repeated col- 
umns? All cases of known best group codes with n < 2 - 1 have no 
repeated columns. 

A strong statement about group codes with no repeated columns that 
might be conjectured is the following: "Let a be an (n,fc)-code with 
n < 2* - 2. Let (B be any (n + 1, /c)-code formed from a by adjoining 
to fl(a) any one of the columns already present in ft(a). Let e be an 
(n + 1, fc)-code formed by adjoining to ft(a) a column c not already 
present in fi(a). Then c can be chosen so that Q(e) ^ Q((B) for all (B." 
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This conjecture has been shown not to be true for all Q. E. F. Moore of 
Bell Telephone Laboratories has constructed a code d such that the new 
code formed by repeating a parity check of a is strictly better than any 
code formed from G by adding a new type parity check. The falsity of 
this conjecture does not preclude the possibility of a thoerem of the sort 
mentioned in the previous paragraph. One should not expect to pass 
from a good (n,/.-) -code to a good (n + 1, A- ) -code in any simple manner: 
the structure of a best (n + 1 , /« - )-code may be quite different from the 
structure of a best (n^O-code. 

In this connection, we point out that there are many (/i,/c)-codes that 
cannot be improved by (he addition of a single parity check. This situa- 
tion obtains whenever the coset leaders of the given code are unique (or, 
in geometrical terms, when there are no vertices of the n-cube on the 
boundaries of the maximum-likelihood regions). Adding a single parity 
check to such a code to form an (n + 1, A-)-code leaves the value of Q 
unaltered. 

The notions of addition and multiplication for group codes can be 
easily generalized to hold for block codes. How much of the theory de- 
veloped remains in this case? 

The foregoing arc but a few of the many questions that arise naturally 
from this work. Most of them have not yet been investigated in any de- 
tail. We have, it is clear, raised more questions than we have answered. 
Perhaps this is inherent in the nature of research. 
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